Chapter 1 
Foundations 



1.1 Introduction 

A macroscopic system is, typically, composed of the order of 10 23 particles. It 
is impossible to know, investigate, or describe the exact microscopic behaviour 
of each individual particle in such a system. We must limit our knowledge to the 
average properties, thermodynamic quantities like the temperature or pressure and 
correlation functions. 

Statistical mechanics is the bridge between the microscopic and macroscopic 
world, it provides methods of calculating the macroscopic properties, like the spe- 
cific heat, from the microscopic information, like the interaction energy between 
the particles. The essential ingredient of statistical mechanics is the probability 
distribution, i.e., the collection of occupancies of different configurations (micro- 
scopic states). 

Phase Space. Consider as an example the ideal gas of N particles in a three- 
dimensional space. The Hamiltonian is 

3N 2 

^ = E|r+E% (1.1) 

i=l Zm ijjH 

(Pi is the component of the momentum, m is the particle mass, and Vy the in- 
teraction between particles. The interaction term is necessary for the system of 
particles to reach thermal equilibrium, but it can be neglected compared to the 
kinetic energy.). The 3iV coordinates and 3iV momenta form the 6iV dimensional 
phase space. Each point in the phase space represents a microscopic state of the 
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system. The microscopic state changes in time according to the canonical equa- 
tions of motion: 

9n , . OH 

Pj = - — and qj = — . (1.2) 

oqj opj 

and traces a trajectory in the phase space. 

Ensembles . The system is completely described if we know the coordinates 
and momenta of all particles (6iV variables - a terrible task). To get an average of 
a physical quantity, say A, one should make the time average over a long segment 
of the trajectory (a collection of consecutive configurations) of such a system in 
the phase space, 

1 rto+At 

(A)= lim — / A[{ qi (t), Pi (t)}]dt. (1.3) 

At^oo l\t Jt 

However, usually we know neither the exact microscopic state, i.e., the loca- 
tion of the system in the phase space, nor the trajectory. What we can know, is 
the macroscopic state (temperature, pressure, volume, ...). Instead of studying a 
particular microscopic state and the trajectory over the phase space, we investigate 
an ensemble of systems, i.e., a collection of all possible microscopic systems, all 
belonging to the same macroscopic state. 

Ergodicity. To calculate the average of a physical quantity, we substitute the 
time average over one system by an average over an ensemble of equivalent sys- 
tems at fixed time: 

(A}=[ Adq^p^pa^p^d^qd^p. (1.4) 
J w 

The integral is over the whole phase space W and p is the probability density 
in the phase space, it is the probability that a unit volume of the phase space 
is occupied. So, instead of the time average, we make an ensemble average at 
fixed time. When the time and the ensemble averages are equal, we say that the 
system is ergodic. In an alternative but equivalent definition we say that a system 
is ergodic if it evolves in such a way that it visits with equal probability all points 
of the phase space which are accessible from the initial configuration subject to 
the constraint of energy conservation. In other words, the trajectory in the phase 
space of an ergodic system will spend equal time intervals in all regions of the 
constant energy surface. Most of the physical systems of interest in statistical 
mechanics are ergodic, so we will in most of the cases replace time averages by 
the corresponding ensemble averages. 
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Figure 1.1: Constant-energy sur- 
face in the phase space. The area of 
the surface in the 6iV-dimensional 
phase space is T(E). 



Figure 1.2: Constant-energy shell 
in the 6iV-dimensional phase space. 
The number of states in the shell is 

AQ(E). 



For the above example of an isolated ideal gas, the total energy of the system 
is constant, H — E, the trajectory lies on the constant-energy surface T(E) in the 
phase space and the ensemble average of A is: 



(A) 



/ A({ qi:Pi })d 3N q d 3N p. 
(E) Jr(E) 



(1.5) 



T(E) Jr(E) 

(The integral is over the constant energy surface T(E).) For quantum systems as 
well as for classical systems with discrete energy levels, the number of configura- 
tions is an extremely irregular function of the energy E. Therefore we introduce 
a narrow energy interval of the width AE and the ergodic hypothesis is general- 
ized so that all the configurations, satisfying the condition that their energy is in 
the interval between E and E + AE, are equally likely to occur. The number 
of configurations Ail with the energy in the interval between E and E + AE 
is proportional to the volume of the corresponding shell in the phase space. For 
indistinguishable particles, AVL is: 

1 



AQ(E) = 



h 3N N\ 



E 



i. 



(1.6) 



E<H<E+AE 



In principle, all systems in Nature obey quantum statistical mechanics, the 
energy levels are discrete, identical particles are indistinguishable and their wave- 
functions are either symmetric (Bosons) or antisymmetric (Fermions) upon ex- 
change of two particles. Classical statistical mechanics is valid only as a special, 
limiting case when the average occupation of any single-particle quantum state is 
« 1. 
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Although we will discuss only statistical mechanics of systems in equilibrium, 
i.e., equilibrium statistical mechanics, there is a growing interest in nonequilib- 
rium statistical mechanics which investigates steady, stationary states of nonequi- 
librium systems. 



An ensemble is a collection of many configurations of a system, all describing the 
same thermodynamic state. We start with a discussion of isolated systems. 

1.2.1 Microcanonical Ensemble and the Entropy 
(Isolated Systems) 

A microcanonical ensemble represents a collection of configurations of isolated 
systems that have reached thermal equilibrium. A system is isolated from its 
environment if it exchanges neither particles nor energy with its surrounding. The 
volume, internal energy and number of particles of such a system are constant 
and are the same for all configurations that are part of the same microcanonical 
ensemble. Instead of working with constant energy surface T(E), we consider all 
the states with the total energy in a narrow energy interval between E and E+AE. 
All such configurations are lying in a thin shell in the phase space and the total 
number of configurations is Af2. 

Closely related to the ergodic hypothesis is the postulate of equal weights 
which says that in equilibrium of an isolated system, all the configurations with 
equal energy are equally probable. For a system, belonging to a microcanonical 
ensemble, therefore, the probability for being in a configuration q^Pi with the 
energy H({q i} Pi}) is: 



A£l(E) is the number of configurations having the energy in the interval E < 
7~L({ ( li,Pi}) < E + AE. All configurations {qi,Pi} which fall into this energy 
interval are occupied with equal probability p({qi,Pi}). 



1.2 Ensembles in Statistical Mechanics 




o 



E<H({qi,Pi}) <E + AE 



otherwise. 



(1.7) 
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Entropy and Probability 

Probably the most fundamental thermodynamic quantity in statistical physics is 
the entropy. Entropy is a concept, defined only for macroscopic systems. A sys- 
tem of only a few particles does not have an entropy. The entropy is a measure of 
disorder in the system, and is an additive function of state. 

Let us consider an isolated system composed of 
two subsystems, which are in contact with each other 
so that they can exchange energy and particles. As 
a result of the contact between the two subsystems, 
an additional uncertainty has been introduced into the 
system (at the beginning we knew the energy and the number of particles of each 
individual subsystem, at the end we know only the total energy and number of 
particles of the whole system). 

We postulate that the entropy is The entropy is an additive quantity, therefore: 

S = S 1 + S 2 (1.8) 

We postulate that the entropy is 




S = k B In Af2. 



(1.9) 



This relation was discovered by Ludwig Boltzmann and is therefore called the 
Boltzmann equation. The proportionality constant k B is the Boltzmann constant 
and is determined by relating the statistical definition of the entropy to the ther- 
modynamic definition. The Boltzmann equation provides the bridge between ther- 
modynamics (entropy) and statistical mechanics (number of configurations). 

The entropy plays the role of thermodynamic potential for microcanonical 
ensembles, (-S) is minimal for an isolated system in equilibrium (V, E and N 
are kept constant). From thermodynamics we know that the total differential of 
the entropy is: 

TdS(E,V,N) = dE + PdV - fidN. (1.10) 

(This is the first law of thermodynamics.) This equation provides a statistical 
definition of the temperature T, pressure P and chemical potential fx: 
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(1.12) 

N,E 



(1.13) 



E,V 



T, p and fi are intensive quantities, they are independent of N whereas the entropy 
and the energy E are extensive quantities, they are proportional to the number of 
particles N. 



1.2.2 Canonical Ensemble and the Free Energy 
(Systems at Fixed Temperature) 

A canonical ensemble is a collection of closed systems at constant temperature. 
Closed systems have fixed number of particles and volume but can exchange en- 
ergy with their surroundings. The energy of a closed system is therefore not con- 
stant. As an example we can imagine a gas of particles (air molecules, e.g.) in a 
closed container at constant temperature. 

Consider now an isolated system composed of 
a small closed (sub)system s with iV particles in 
a volume V and of a "heat bath" (b) at tempera- 
ture T. Let the two subsystems be in contact so 
that they can exchange energy but no particles. In 
equilibrium, the system s has equal temperature 
as the heat bath. Now, the energy of the small 
system, E s , is no longer fixed and the system s 
will be in any energy state E s , in each one with 
a different probability p s . The heat bath must be 
large (N b 3> N s ), so that the change in the energy 
of the bath, E b , during energy exchange between 
the small system and the bath, is negligible. Ev- 
idently, since the compound system (= system + 
bath) is isolated, the total energy E t = E b + E s is constant and the compound sys- 
tem belongs to a microcanonical ensemble for which the number of configurations 
in the energy interval between E t and E t + AE is: 




Figure 1.3: A small closed 
system (s) in contact with a 
large system, called "bath." 
s and bath can exchange en- 
ergy. 



AQt(E t ) = AQ s (E s )AQ b (E t - E s 



(1.14) 
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We first express A£l b with the entropy via the Boltzmann equation (1.9) and then 
expand In Ail b to first order in E s : 

(<99 \ E 
-^\E s = S b {E t )-^. 

(1.15) 

Thus, 

AQ b (E t - E s ) = AQ b (E t ) e"^ = C e~ pE '. (1.16) 

Here, the constant C is independent of E s and (3 is the inverse temperature, (3 = 
l/k B T. 

The (normalized) probability for the system s having the energy between E s 
and E s + dE s is: 

nfFWF - ^s(E s )An b (E t -E s )dE s 

P[ s) s ~ fdE s AQ s (E s )An b (E t -E s y {LU) 

After expressing Ail b (E t — E s ) with (1.16) we find the probability density: 

p(E s ) = ip(£ s ) e -^, (1.18) 

where p(E s ) = Ail(E s ) / AE is the density of states (number of states per unit en- 
ergy interval). Z is called the partition function and is the normalization constant, 
depending on the temperature, volume and number of particles of the system s: 



Z(T,V,N) = J p(E)e~^ E dE. (1.19) 



(Here we omit the index s.) Z(T, V, N) is a Laplace transform of the microcanoni- 
cal partition function AQ(E) = p(E)AE. For systems with discrete energy levels 
we replace the integral either by a sum over all the energy levels /: 

Z{T,V,N) = Y,9ie- pEl (1-20) 
i 

(gi is the degeneracy of the energy level /), or by a sum over all configurations i: 

Z(T,V,N) = Y, Q ~ PEi - ( L21 ) 
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The role of Z is much more important than just being the normalization con- 
stant. Z is obtained by integration over the whole phase space. In this way infor- 
mation on microscopic states of the system (coordinates and momenta of individ- 
ual particles, e.g.) becomes lost but all thermodynamic information on the system 
(with prescribed temperature, number of particles and volume) is retained and can 
be obtained from Z, as we shall see below. 

The distribution in which the particles are in equilibrium with a heat bath at 
temperature T is called a canonical distribution similarly as the ensemble defined 
by this distribution is called a canonical ensemble. For a system in equilibrium at 
a fixed temperature, the system can (at least in principle) asses any energy. The 
probability density p(E) is the same for all states with the same energy but it 
decreases exponentially with increasing energy. 



Free Energy 



In this Section we will see the relation between the average of a physical quantity 
of a canonical ensemble and the partition function Z. 

The average energy (E) and average generalized force (X) in a canonical 
distribution are given by 

(E) = ^ J E p(E)e~^ E dE = --^InZ, (1.22) 



\ I Xp(E) e^ E dE = J 



dp 

dE e -/3E dE _ 9 1 \ nZ 
dx dx p 



(1.23) 



x is the generalized coordinate, conjugate to the generalized force. Examples of 
conjugate forces and coordinates are: pressure vs. volume in gases, magnetic field 
vs. magnetization in magnetic systems; the generalized force is intensive while 
the coordinate is an extensive quantity. 

We introduce the (Helmholtz)/ree energy as: 



F(T, V, N) = -k B T In Z(T, V, N) 



(1.24) 



Like the Boltzmann equation (1.9) in case of the microcanonical ensemble, also 
this equation relates thermodynamics (free energy) and statistical mechanics (par- 
tition function). 

Relation between F and S : We take the well-known relation from thermody- 
namics: 

F(T, V, N) = (E(S, V, AO) - TS, (1.25) 
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F(T, V, N) is a Legendre transform of (E(S,V, N)), by which the independent 
variables are changed from (S, V, N) to (T, V, N). 
The total differential of F is: 

dF = -SdT - PdV + fjtdN. (1.26) 

Another Legendre transform relates the Helmholtz and the Gibbs free energies 
F(T, V, N) and G(T, P, N): 

G(T,P,N) = F(T,V,N) + PV (1.27) 

For a list of thermodynamic functions and their derivatives, see Tables 1 to 3 in 
the Appendix B. Exercise: Construct these tables for magnetic systems! 

Stability and convexity of the free energies (See Fig. 1.4). The Helmholtz free 
energy F(T, V) (for simplicity, we will omit N) is a concave (i.e, the second 
derivative is negative) function of T and convex function of V and the Gibbs free 
energy G(T, P) is always a concave function of both T and P. 




V p 



Figure 1.4: Schematic behaviour of the Helmholtz and Gibbs free energies. 

These properties follow from the fact that the system must be thermally and 
mechanically stable, therefore the specific heat and the compressibility must be 
positive quantities. We begin by noting that 

It follows that 

f) 2 G r)^ 1 
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and 

Hence, G(T,p) and F(T, V) are concave functions of T. 

Together with equation (1.26) we see that for a system in equilibrium at con- 
stant T, V, N the distribution of a system over possible configurations is such that 
F is minimal. Therefore F is also called canonical or Gibbs potential. 

The next two properties are obtained by differentiating G(T, P) and F(T, V) 
with respect to pressure and volume, respectively: 

r) 2 C r)V 
rP' F f)P 1 

(^7i) =-fe) =^7— (L32) 

Hence, G(T, P) is a concave function of pressure P and F(T, V) is a convex 
function of volume V. 

The above properties are valid also for systems that undergo phase transitions. 



1.2.3 Grand Canonical Ensemble 
(Open systems) 

Consider now a more general case with the system 
of volume V s being not only in contact with a heat 
bath at temperature T, but also exchanging parti- 
cles with the bath. As an example we can imagine 
a room at constant temperature with an open win- 
dow. In this case, neither the energy nor the num- 
ber of particles in the system (air molecules in the 
room, e.g.) are fixed. Such a system is described 
by the grand canonical distribution. 
We proceed like in case of the canonical ensemble, we consider the total sys- 
tem being part of a microcanonical ensemble, therefore the number of configura- 
tions of the total system is: 



s 

bath 



AQ(E t , N t ) = AQ^E,, N s ) AQ b (E t - E s , N t - N s ). (1.33) 
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We express Af2 b with the entropy via the Boltzmann equation and then expand 
In AQ b to first order in E s and N s : 



k B lnAQ b (E t -E s ,N t -N s ) = S b (E t - E„ N t - N s ) 

« S b (E t ,N t )-(^jE s 

= S b (E t ,N t )-f + ^ 



ON 



Thus, 



(1.34) 



AQ b (E t - E s , N t -N a ) = C e-^--^). 

Eventually we find for the probability density of a system having the energy E 
and N particles: 

p(E, N) = ^ p(E, N)q-^ e -" n \ (1.35) 

where the normalization constant S is called the grand (canonical) partition func- 
tion: 



N J 



(1.36) 



(Again, we omit the index s.) The grand partition function S is related to the 
partition function Z: 



Z(T,V,ri = Y,Z(T,V,N) e^. 



(1.37) 



N 



Thermodynamic quantities in the grand canonical ensemble 

In analogy to the free energy in the case of a canonical ensemble, we introduce 
the grand (canonical) potential J which will be used for open systems: 



J(T,V,n) = -k B T\nE 

The total differential of J is: 

dJ = -SdT - pdV - Ndp. 
The entropy can now be expressed as 



(1.38) 



(1.39) 



(1.40) 
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the pressure is: 



9V / 7> 



and the number of particles is 



\dn) Ty V d V Jt,v 

For a system in equilibrium at constant T, V, and the distribution of a system 
over possible configurations is such that the potential J is minimal. 



1.3 Analogy Between Fluids and Magnetic Systems 



Above, we have mainly discussed fluids (liquids, gases). When we want to con- 
sider, e.g., magnetic systems, the above relations between thermodynamic quanti- 
ties are easily written down for them as well. The potential energy of a magnetic 
dipole pi in a magnetic field H is 

W = -fiH (1.43) 

and the work required to increase the magnetization of a system by dM is: 

-Hdn. (1.44) 

Hence, the first law of thermodynamics for magnets reads: 

TdS = dE — HdM (1.45) 

Comparing this equation with 1.10 we see that we only have to replace the "gen- 
eralized force" - pressure P by the "force", acting on the magnetic moment, i.e., 
by the negative magnetic field: 



p -> -H. 



(1.46) 



Similarly, the "generalized coordinate" V is replaced by the "generalized coordi- 
nate" of magnetic systems, M: 



V -> M. 



(1.47) 



Notice that P and H are intensive quantities whereas V and M are extensive. 
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1.4 Fluctuations 

The microcanonical ensemble describes a collection of isolated systems where 
neither energy nor the number of particles can fluctuate. 

Energy fluctuations in the canonical ensemble: The canonical ensemble de- 
scribes a system in contact with a heat bath. For such a system, the energy is 
not exactly fixed, it can fluctuate around (E). We will now evaluate the square of 
the energy fluctuations, 

(AE) 2 = ((E - (E)) 2 } = (E 2 ) - (E) 2 . (1.48) 

In the canonical ensemble, the thermal average of the energy is 

<*> = 4| (1.49, 



and the thermal average of the energy squared is: 

l r „o .„ l d 2 z 

zW 2 

So, the square of the energy fluctuation is 



(E 2 ) = \ JE 2 P (E)e-^dE = ig. (1.50) 



{AE) ~zW~ { zW ~^ 2 ~- (L5 ) 

After expressing this with (E) (see paragraph 2.3.3) we get: 

w = -m =kBl *m (1 .52, 

(AE) 2 = k B T 2 C v . (1.53) 

Here, C v is the heat capacity, it is an extensive quantity and is proportional to N. 
The relative fluctuation of the energy is thus: 



AE k B c v T 

M = V^7' (L54) 

where e is the energy per particle and c v is the specific heat at constant volume, 
cy = Cy/N. The relative energy fluctuation is oc l/y/N and it vanishes as 
N — > oo, see Fig. 1.5. For macroscopic systems (i.e., in the limit N — > oo), the 
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Figure 1.5: Fluctuation in the energy of a small (a) and of a large (b) system. 

distribution of energies in a canonical ensemble is so sharply peaked around the 
average energy that the canonical ensemble is equivalent to the microcanonical 
ensemble. For later use we write Eq. (1.54) in the form: 



NT 



((E 2 )-(E) 2 ) (1.55) 



Fluctuations in the grand canonical ensemble: Now the number of particles is 
not fixed, so we shall calculate AiV (and AE). The calculation is analogous to 
the above calculation for the canonical ensemble. We start with the grand partition 
function 

E(T, V,n) = Y,l p{E)z-^ E ^ N) dE (1.56) 

N J 

and differentiate it twice with respect to \x by keeping j3 and V constant, 

w= mm a57) 
^=ikw- a58) 

The square of the particle number fluctuation is: 

(AN) 2 = { N* } - { Nf = {^0) tv „,9, 

For fluids at constant T and V, we obtain from the thermodynamic relation (See 
Table 1) pV = k B T InZ: 
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<9 2 ln2 V d 2 p 
dfi 2 = k^fdj^' ( ' } 

We assume that the (Helmholtz) free energy can be written as F(T, V, N) 

= Nf(T, v), where /(T, v) is the free energy per particle and depends on T and 

v = V/N. Then, 

fi(T,p) = f(T,v)+pv (1.61) 

and 



d 2 p 
dfi 2 


d /r 

dfi \v, 


)- 


1 dv 
v 2 dfi'' 


dfi 

dv 


dfi dp 
dp dv 


dp 
dv 


1 



where 



n T is the isothermal compressibility. We get finally that 



(1.62) 
(1.63) 



(N 2 ) - (Nf = {N)kBTKT . (1.64) 

v 

The square of the fluctuation in the number of particles is proportional to the 
(isothermal) compressibility! This equation shows also that AiV oc y/N and that 
AN/ (N) vanishes as N — > oo. We conclude that the grand canonical ensemble is 
equivalent to the canonical ensemble when (N) — > oo. The decision about which 
ensemble is to be used to describe the investigated system does not depend on 
whether the system is closed or open, but it is a matter of convenience. For later 
use we rewrite Eq. 1.64 in a different form: 

«r = {(N 2 ) ~ (AO 2 ) (1.65) 

The limit iV — > oo, in which the relative fluctuations become negligible, is 
called the thermodynamic limit. So far we assumed c v or k t to be constant. 
At a continuous phase transition however (see Section 1.5), these quantities and 
consequently also the corresponding fluctuations diverge on all lengthscales. This 
makes life of experimentalists and of those who make simulations on computers 
(both can deal with finite systems only) very difficult. 

The fluctuations of iV around (N) or E around (E) are - of course - time- 
dependent processes! Therefore we have to assume that the systems are ergodic 
in order to identify the time average with an ensemble average which we actually 
calculated. 
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Fluctuation-Dissipation Theorem 

Above, we have shown that (AE) 2 is proportional to the specific heat c v and that 
(AN) 2 is proportional to the compressibility. In the problem 3 we also see that 
(AM) 2 is proportional to the susceptibility. All these examples indicate that there 
is a general relation between the fluctuations of the generalized coordinate and the 
response of this coordinate to the perturbation of the conjugate generalized force. 

This is the message of the fluctuation-dissipation theorem which in a most 
general way relates the fluctuations of a physical quantity of a system in equilib- 
rium to a dissipation process which is realized when the system is subject to an 
external force driving it away from equilibrium. The theorem makes it possible 
to find the non-equilibrium properties of a system from the analysis of thermal 
fluctuations of the system in equilibrium. It is a bridge between non-equilibrium 
and equilibrium statistical mechanics. 

Now let us have a look at magnetic systems. The magnetic susceptibility, i.e., 
the response of the magnetization M to the extermal magnetic field H is: 

j ((M 2 ) - (M) 2 ) . (1.66) 
If we write M = J2i Si, the susceptibility becomes: 



X N 



X = j f T,[(^S J )-(S t )(S,)]. (1.67) 
The summand on the right-hand side is the spin-spin correlation function, 



T ij = [(S i S j )-(S i )(S j )]. (1.68) 



which describes the correlations in the spatial fluctuations of the spin around its 
thermal average. Because of the interaction between the nearest-neighbouring 
spins, one expects that the spins are correlated on short distances and that their 
fluctuations are less and less correlated as the distance increases. The correlation 
function thus decays with the distance. Often T will be assumed to have the form 

r(r) oc r- p e~ r/ «, (1.69) 

where the decay length £ is called the correlation length. As we shall see later, £ is 
a temperature-dependent quantity which plays a crucial role in phase transitions, 
it diverges at a continuous phase transition. 
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Figure 1.6: Chemical potentials of two phases in contact. When Hi = /j, 2 , the 
two phases coexist. In figure (a) the chemical potentials cross and the transition is 
first order. Dashed portions represent unstable states. In figure (b) the transition 
is continuous and the two phases meet in the critical point CP. 



1.5 Phase Transitions 



So far we have considered only homogeneous systems, i.e., single phases. In 
Nature there are, however, many systems that exist in different phases. Examples 
are solid-liquid-gas, magnetic, ferroelectric, • • •, systems. In this Section we will 
discuss transitions between such phases. 

When two phases, say 1 and 2 are in contact with each other, there is an inter- 
face separating the phases. In equilibrium, the chemical potentials of both phases 
in contact are equal, 



(1.70) 



and the two phases coexist (See Figure 1.6). 



Classification of Phase Transitions 

As one of the parameters (e.g., the temperature) is varied in such a way that the 
coexistence line is crossed, the system undergoes a phase transition between the 
two phases. At the phase transition a derivative of the free energy (or some other 
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thermodynamic potential) is discontinuous. The free energy (thermodynamic po- 
tential) becomes non-analytic in this point. The transition can be either first order 
or continuous. 

(a) First-order phase transitions. The conditions for first-order phase transi- 
tions are that the chemical potentials are equal, 



Ap = p 1 (T,p,---)-p 2 (T,p, ■■■)=(), 



(1.71) 



and that their derivatives are different, 




(1.72) 



so that the chemical potentials or the free energies cross at the transition. The 
phase with the lower chemical potential is stable and the other phase is metastable. 
An example of a first-order phase transition is the liquid-gas transition. 

(b) Continuous phase transitions. A transition is continuous when the chem- 
ical potentials of both phases are equal and when their first derivatives are also 
equal, 



A f i = fi 1 (T,p,---)- f x 2 (T,p, ■■■)=(), 




(1.73) 



(1.74) 



so that the chemical potentials or the free energies have a common tangent at the 
transition. There is no latent heat in this type of transition. 

Instead of continuous transitions, some authors write about second, third, and 
higher order transitions, depending on which derivative of the chemical poten- 
tial diverges or becomes discontinuous. This classification is somewhat arbitrary, 
therefore we will distinguish only between the continuous and first-order transi- 
tions. 



1.5.1 Order Parameter 

As an example, let us consider a simple ferromagnetic material. At high temper- 
atures, there is no magnetization and the system is rotationally invariant. At low 
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temperatures, when spontaneous magnetization occurs, the magnetization direc- 
tion defines a preferred direction in space, destroying the rotational invariance. 
We call this spontaneous symmetry breaking and it takes place at the critical tem- 
perature (for ferromagnets it is the Curie point). Since a symmetry is either absent 
or present, the two phases must be described by different functions of thermody- 
namic variables, which cannot be continued analytically across the critical point. 

Because of the reduction in symmetry, an additional parameter is needed to 
describe the thermodynamics of the low-temperature phase. This parameter is 
called the order parameter. It is usually an extensive thermodynamic variable. In 
the case of ferromagnets, the order parameter is the thermal average of the (total) 
magnetization, (M) . For the gas-liquid transition, the order parameter is either the 
volume or the density difference between the two phases. Notice that the density 
is not an extensive quantity ! Notice also that there is no obvious symmetry change 
in the gas-liquid transition. 

The basic idea of phase transitions is that near the critical point, the order 
parameter is the only relevant thermodynamic quantity. 

Some examples of the order parameters and conjugate fields are given in the 
following table: 



Systems 


Order Parameter 


Conjugate Field 


Gas-liquid 


Vg-Vl 


P-Pc 


Ferromagnets 


M 


H 


Antiferromagnets 


-^■staggered 


H staggered 


Superfluids 


(Condensate wave fn.) 


Not physical 


Superconductors 


A 

(Gap parameter) 


Not physical 



1.5.2 Critical Point 

1. Liquid-gas transitions. In Figure 1.7(a) a typical phase diagram of a solid- 
liquid-gas system in the P—T plane at constant V and N is shown. Here we would 
like to concentrate on the liquid-gas transition. The liquid and the gas phases 
coexist along a line where the transition between these two phases is first order. 
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If T is increased, the coexistence line terminates in the critical point, where the 
transition between the two phases is continuous. Beyond the critical point, there 
is no transition between the two phases, there is no singularity in any physical 
quantity upon going from one phase to the other. It is also instructive to consider 
the isotherms in the P — p plane at constant T and N, see Fig. 1.7(b). At low 
temperature, there is a large difference between the gas and liquid densities, pa 
and pl, but as the critical temperature is approached, this difference tends to zero. 
The existence of a quantity that is non-zero below the critical temperature and zero 
above it, is a common feature of critical points in a variety of different physical 
systems. p L — pais the order parameter for the liquid-gas critical point. 

2. Ferromagnets. A typical phase diagram of a ferromagnet is shown in Fig. 
1.8(a). The order parameter is the magnetization M, i.e., the total magnetic mo- 
ment. At low temperature, M is ordered either "up" or "down", depending on the 
external field H. When H changes sign, the system undergoes a first-order phase 
transition (bold line) in which the magnetization changes its direction discontin- 
uously [Fig. 1.8(b)]. As T is increased, the critical point is reached, at which 
M changes continuously upon variation of H but its derivative with respect to H, 
i.e., the susceptibility diverges. At still higher T, there is no phase transition, the 
spins are simply disordered, this is the paramagnetic region. 



1.5.3 Critical Exponents 

In this Section the behaviour of the thermodynamic quantities near the critical 
point is discussed. We suppose that very near the critical point, any thermody- 
namic quantity can be decomposed into a "regular" part, which remains finite (not 
necessarily continuous) and a "singular part" that can be divergent or have diver- 
gent derivatives. The singular part is assumed to be proportional to some power 
of \T-T C \ (orp- Pc ). 

Definition of the critical exponents. For clarity, we will define the critical ex- 
ponents on a ferromagnet. However, their definition will be general and will be 
valid for arbitrary system that undergoes a continuous phase transition. The most 
important critical exponents are: 

P = Order parameter exponent. When H = 0, the magnetization M in a 
ferromagnet is a decreasing function of T and vanishes at T c (See Fig. 1.9). 

For T very close to (but below) T c , M can be written as 

M~(T C -Tf. (1.75) 
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Figure 1.9: Order parameter vs. temperature and field. 

(3 is the order parameter exponent which describes the behaviour of M near Tq. 
Here and later, ~ means "the singular part is proportional to". 

5 = Exponent of the critical isotherm. When T = T c , M vanishes for H = 
but increases very rapidly if H increases. For small H, the singular part of M is 
proportional to: 

M ~ H 1/s , (1.76) 

where 5 > 1. 

7 = Susceptibility exponent. As T c is approached either from above or from 
below, the susceptibility diverges. The divergence is described with the exponent 

7: 

X ~\T-T c \-\ (1.77) 

Notice that the exponent 7 is the same for T > T c and T < T c whereas the 
proportionality constants are different. 

a = Specific heat exponent. The specific heat at constant volume (for ferro- 
magnetic systems one has to take H = 0) has a singularity at Tq. This singularity 
is described by the exponent a: 

C V ~\T-T c \~ a . (1.78) 

As usually, the exponent a is the same for T > T c and T < T c whereas the 
proportionality constants are different. 

v = Correlation length exponent. As already mentioned, the correlation length 
£ is a temperature- dependent quantity. As we shall see later, £ diverges at the 
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critical point with the exponent v. 

i~\T-T c \~ v . (1.79) 

i] = Correlation function exponent at the critical isotherm. At Tq, £ diverges 
and the correlation function T decays as a power law of r, 

T ~ r d ' 2 +\ (1.80) 

where d is the dimensionality of the system. 

Scaling. As the name suggests, the scaling has something to do with the 
change of various quantities under a change of length scale. Important scaling 
laws concerning the thermodynamic functions can be derived from the simple 
(but strong) assumption that, near the critical point, the correlation length £ is the 
only characteristic length of the system, in terms of which all other lengths must 
be measured. This is the "scaling hypothesis." 

With the aid of the scaling hypothesis we are able to get relations between the 
critical exponents. The most common scaling relations are: 



7 = P(5 - 


1) 


7 = u{2 - 


v) 


a + 2(3 + 7 


= 2 


vd = 2 - 


a 



(1.81) 



so that only two of the above exponents are independent. The last four equations 
are called the scaling laws. We shall prove some of the scaling laws later. 

Universality. Some quantities depend on the microscopic details of the system. 
Examples of such quantities are: 

- The critical temperature depends on the strength of interaction. 

- The proportionality constants (e.g., for the temperature dependence of the 
magnetization) also depend on the microscopic properties of the system. 

On the other hand, the critical exponents and the functional form of the equa- 
tion of state, of the correlation functions, etc. are independent of many details of 
the system. They depend only on global features, such as: 

- The spatial dimensionality, 

- symmetry (isotropic, uniaxial, planar,...), ... . 

Systems that have the same critical exponents and the same functional form 
of the equation of state, etc, belong to the same universality class. For example, 
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the Ising model in d = 2 forms one universality class, whereas in d = 3 it forms 
another universality class, the Ising models in d = 2 and d = 3 have different 
critical exponents because they have different spatial dimensionality. However, on 
a first glance very different physical systems often belong to the same universality 
class. Example: binary alloys and some magnetic systems can be described with 
mathematically similar models and they belong to the same universality class. 
Roughening of some crystal surfaces at high temperature (but below the melting 
temperature) and the d = 2 Coulomb gas are members of another universality 
class. 
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